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UNIFORM CONVERGENCE OF EXACT LARGE DEVIATIONS 
FOR RENEWAL REWARD PROCESSES 1 

By Zhiyi Chi 

University of Connecticut 

Let (X n ,Y n ) be i.i.d. random vectors. Let W(x) be the par- 
tial sum of Y n just before that of X n exceeds x > 0. Motivated by 
stochastic models for neural activity, uniform convergence of the form 
sup c6J |a(c, x) Pr{W(x) > cx} — 1| = o(l), x — > oo, is established for 
probabilities of large deviations, with a(c, x) a deterministic function 
and I an open interval. To obtain this uniform exact large devia- 
tions principle (LDP), we first establish the exponentially fast uni- 
form convergence of a family of renewal measures and then apply it 
to appropriately tilted distributions of X n and the moment generat- 
ing function of W(x). The uniform exact LDP is obtained for cases 
where X n has a subcomponent with a smooth density and Y n is not 
a linear transform of X n . An extension is also made to the partial 
sum at the first exceedance time. 

1. Introduction. 

1.1. Background. Let (X n ,Y n ) be i.i.d. ~ (X,Y) £ R 2 . For x > 0, let 

:^2Xi <x,Wk<n\, if X x < x, 

otherwise, 

N(x) N{x) 

S(x) = Xi, W{x) = ]T Yt, 

i=l i=l 
where Ya=i := if n = 0. It will hereafter be assumed that 

(1.1) X and Y are nondegenerate and Pr< sup V^Xj = oo > = 1. 

U>! 1= 1 J 
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The process {W(x),x > 0} is often called a continuous-time random walk 
or renewal reward process (cf. [1] and references therein). There have been 
many studies of the LDPs for N(x) and W(a;) and related issues for exit 
points, often in the more general context of Markov additive or renewal 
processes [7, 9, 10, 11, 15, 16, 18, 19, 21, 22, 23, 26]. 

In this article, we consider the uniform exact LDP for the random sum 
W(x), which refers to asymptotics of the form 

sup|a(c, x)Pi{W(x) > cx} — 1| = o(l) as x — > oo, 
eel 

with I being an open interval and a(c,x) a deterministic function. Our 
interest in this problem originates from research in neuroscience. In elec- 
trophysiological studies, neuronal activity is recorded as sequences of pulses 
in voltage generated by neurons and can be modeled as point processes. In 
some cases, the neuronal activity can be regarded as consisting of consecutive 
"epochs" such that the activities therein are driven by the same underlying 
mechanism [4]. Each epoch yields a measurement, such as the number of 
pulses during its duration, and the cumulative measurement within a period 
of time is of interest. Let Xk and Yk be the duration and measurement of 
the kth epoch, respectively. Then the overall measurement up to time x is 
W(x). It is useful to understand the probabilistic properties of W(x), such 
as the fluctuations in the number of pulses generated by a neuron over the 
long term. In the simplest models, the epochs are independent of each other, 
which gives rise to the problem at hand. Although X n is positive for neural 
activity, in general this is not a required assumption. 

The exact LDP is known for the case where c is fixed (cf. [15, 26]) and 
for other related cases, such as the degenerate case Y = 1 [8]. However, 
the available results are not sufficient in some applications. For instance, 
when dealing with the number of pulses in neural activity, X n may vary 
continuously while Y n are integers. Since W(x) > cx is equivalent to W(x) > 
\cx~\ = c*x, with c* varying according to x, it is necessary to consider the 
convergence for c* in a neighborhood of c instead of for c alone. 

1.2. Overview. Our "plan of attack" is as follows. We choose the uniform 
exact LDP of [3] as the basic tool, which requires some careful analysis of 
the moment generating function of W{x). Henceforth, denote 

(1.2) M x (z) = E[e zW (% g x (z)=g(z,x) = E[e zY \X = x], zGC. 

It is seen that for t £ R, M x (t) = Pi{X > x} + Jf^ g u (t)M x _ u {t)F{du). 

We have to make sure that asymptotics of the form M x (t) ~ a(x, t)e b ^ x 
hold uniformly well for t £ I, where a(x, t) and b(t) are deterministic func- 
tions and 1^0 is an open interval. Suppose that E[e tY ~ h ^ x ] = 1 for 
some function h(t). Letting <p x {t) = ^ t yJ then yields renewal equations 
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<t>x(t) = ip x (t) + J-oo (j>x-u(t)F t (du), where F t (du) = j}^F(du) is a proper 
probability measure. By the standard theory [2, 5], for each t, <j) x {t) converges 
and so M x (t) ~ <j> x {t)e h( $ x . However, it is necessary to show uniform conver- 
gence for (fi x (t) . One approach is to first establish the uniform convergence of 
the renewal measures associated with Ft. Indeed, if h(t) is smooth, then the 
family of Ft is smooth in a certain sense, which facilitates the establishment 
of the uniform convergence of the renewal measures. Next, provided ifi x (t) 
are uniformly integrable, the uniform convergence of (fi x (t) can be obtained. 
We can then check necessary conditions on M x to obtain the desired result 
for W(x). In particular, we need to establish uniform bounds on M £^^ . 
Suffice it to say, our derivation of the bounds critically depends on the uni- 
form asymptotics of M x (t), the smoothness of Ft and the assumption that 
Y is not a deterministic affine function of X . 



Notation. Recall that a connected component of A C R is a maximal 
nonempty interval in A and the interior of A is A° = {x:{x — r,x+) C 
A for some r > 0}. The Lebesgue measure will be denoted by i. Define 
a V b = max{a, b}, a A b = min{a, b}. By convention, we let inf = oo and 
sup = — oo. 



1.3. Main results. To carry out the plan outlined above, we shall first 
generalize the convergence of renewal measures associated with one mea- 
sure [17, 24, 25] to exponentially fast uniform convergence for a family of 
measures. This can be done in a setting not specific to the uniform exact 
LDP. For a probability measure p on R, denote by \i v its mean and by 
N p = J2'n=oP n * t ne associated renewal measure, where p n * is the n-fold con- 
volution of p, with p°* :=5(x). Denote by sppt(p) the support of p. If X ~ p, 
also let sppt(X) =sppt(p). The next result generalizes those in [12], which 
are restricted to X > 0, and gives no bounds on the convergence of densities. 
For uniform convergence with power rates, see [13, 14]. 

Theorem 1.1 (Uniform convergence of renewal measures). Let M be a 
family of probability measures on R such that 

(1.3) inf Up > 0, 

(1.4) M T := sup E p [e T \ X \] < oo for some t > 0. 

P&M 

Suppose that each p € M is a mixture of two probability measures <& p and 
typ, where 



(1.5) 



p=(l- Xp)^p + Xp^ p , 0<A P <1, 
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such that $ p has a density (f> p and 

(1.6) 7 := sup X p < 1. 

P&M 

Furthermore, suppose that there exists T E (0, oo) such that 

(1.7) ^eC 2 ((-T,T)) VpeM 

fT 

(1.8) sup / \(f>"(x)\dx <oo. 

Then N p = Q p + N p such that Q p has a density q p , sup peM -^p(^) < 00 an d 
for all <r< 1, 

(1.9) Ai := sup {e rx \q p (x) - fx" 1 ]} + sup {e rx g p (-x)} < oo, 

z>0,p€.M x>Q,p&M 

(1.10) A 2 := sup {e rx N p ((-oo,-x} U [x,oo))} < oo. 

x>o,peM 

We will need two corollaries of Theorem 1.1. Corollary 1.2 is based on 
Corollary 1.1 and is the one which will be used directly in obtaining the 
uniform exact LDP. 

Corollary 1.1. Let z p (x) be functions onl. Suppose that there exists 
rj > such that L := sup xG ^ pe j^ /l {e v ^\z p (x)\} < oo. Then for each p, there 
exits a unique solution Z p to 



Z p (x) = Zp(x) + Z p (x- y)p(dy) 

J —oo 

(1.11) 

such that sup{e £X Z p (x)} < oo, Ve > 0. 



Let u p = fip 1 j z p (x)dx. Let r,Ai,A 2 be the same as in Theorem 1.1 and 
let a= imin(f7,r). Then there exists a continuous function C( ) such that 

sup {e ax \Z p {x) - u p \) + sup {e a W\Zp{x)\) 
x>0,p&M x<0,p£M 

(1.12) 

<C(A 1 ,A 2 ,L,rj,r). 

Corollary 1.2. Let z p (x) be defined on x>0 and r\ 6 (0,r) such that 
L\ '■= sup x>0 „ &M {e vx \z p (x)\} < oo, where r is as in (1-4)- Then 

(1.13) Zp(x) = z p {x)+ [ Z p (x-y)p{dy) Vx > 0, p£M, 

J —oo 
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z p (x)dx — J (^J Z p {x) dx^jp(dy) 



has at most one solution satisfying L2{e) '■= su Px>o,peMi e £X ^p( x )} < °°> 
Ve > 0. If the solution exists, then as x — > oo, 

l [ r°° r° ( r\y 

(1.14) Z v (x)^u v := — 

fJ>p 

and for a = \ min(r/, r), L = L\ V (I>2(??)M r ) and C(-) as in Corollary 1.1, 

(1.15) sup (e ax \Z p (x)-u p \)<C(A 1 ,A 2 ,L,7 1 ,r). 

x>0,p<=M 

Conditions (1.6) and (1.7) in Theorem 1.1 imply that Stone's decompo- 
sition can apply uniformly well for p £ M. [25]. Conditions (1.7) and (1.8) 
imply that 4> p have bounded oscillations, so they cannot cluster around a lat- 
tice distribution. The conditions also imply that the characteristic functions 
of 4> p are uniformly integrable and can hence be inverted, which facilitates 
the analysis of the tail of (ft p . As indicated earlier, the condition (1.4) can be 
met by tilting a measure with a smoothly parameterized family of functions. 

Returning to the LDP for W(x), define 

V t = {s£R:E[e tY - sX ] < 1} Vi G E, 

h(t) = MV t , h*(v) = sup{vt-h(t)}, 

t 

0x = limsup(l/a;) logPr{A" > x} < 0. 

x— too 

For what values of c can a nontrivial LDP be expected for Pr W(x) > cxl 
If X > and Y are independent, then the LLN implies that c > cq := 
due to N(x) « -j^x and W(x) « N(x)EY « cox. In general, the answer de- 
pends on the properties of h(t). In the following theorems, tq > is a basic 
assumption in order for a nontrivial LDP to arise for c = h'(t) when t takes 
values across a neighborhood of To. Note that by the assumptions of the 
theorems, Y is not a deterministic linear function of X. Therefore, the case 
Y = 1 studied in [8] is not covered here. 

Theorem 1.2 (Uniform exact LDP, nonlattice case). Let tq > and 

(1.16) h(r ) G (/?x, oo), inf E[e ToY+sX ] < 1. 

Suppose the following conditions (1)~(4) are satisfied. 

(1) The law of X can be decomposed into the sum of two nonnegative 
measures $ and ^ such that $(M) > with a density <f> 6 C 2 (M). 

(2) There exists k € N and r]Q> such that 

(1.17) £|£[e is(yi+ - +yfe) |Xi + ---+X fc ]| <1 Vs£]R\{0}, 

(1.18) £[ e -fc(To)X+T y+r, (|X| + m)] < ^ 
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(3) With the same r/o as in (2), 

g( t, X ), e C((r - 77.ro + r?) x sppt($)°). 

(4) In the case where Pr{X > 0} < 1, 

(1.19) £[ e g(To5MOAh(T ))x) |x > 0] < oo Vg > 0. 

Then there exists I = (r -e,r + e) / suc/i i/iai /i G C°°(I), E[e tY ~ h( ^ x ] 
1 and /i"(t) >0fort£l and 

t 



(1.20) sup 

tei 



2nxh"{t)e xh ' {h ' {t)) Vv{W{x) > xh'{t)} - 1 



= o(l) 



as x — > oo ; where 

C 1 - 21 ) 0< ^ := g[ /J^U] <00 ' 

mi/i < -B(X, i) < oo given fry 

B(X, = f - f f 4uF(4 x) . 

x ' Jo e h( A x J-och e h (*)(*-H«) y ' 

In particular, if X > a.s., then 

B(x t) _ f ^)- X (l " E[e- h ^ x ]\ if hit) ± 0, 
^ Alt) -\E[X\, ifh(t) = 0. 

Corollary 1.3. Under the assumptions of Theorem 1.2, given a, b S K, 

' iro)e~ xh * ( h ' ( T °^ +ah ( T °}~ bT ° 



(1.22) Pr{W{x + a)>xti(T ) + b} 



T 0v / 27rxh"(T ) 



If Y has a finite moment generating function, then the results generalize 
to the sums at the first passage time without much extra effort. Let 

C n \ T{x) 

T(x) = mmln:J2Xi>x\, W(x) = J2 Y *- 

I i=l J i=l 

Corollary 1.4. Suppose that (1.16) and conditions (l)-(3) of Theo- 
rem 1.2 hold and that E[e tY ] < oo for all t. Additionally, ifPr{X > 0} < 1, 
then instead of (1.19), suppose that 

(1.23) E[e- qmin ^' h ^ x 1{X > 0}} <oo Vg>0. 

Then with W(x) being replaced by W{x) and </>(i) replaced by 
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(1.22) still holds. The function B(X,t) is defined as 

In particular, ifX>0 a.s., then 

B(X t) - I Kt)- X E[^{\ - e-W x )], if h(t) + 0, 
B[X ^-\E[Xe tY ], ifh(t) = 0. 

Now consider the case where Y is lattice-valued. Recall that a random 
variable £ is said to have span d > if d = m&x{t > : Pr{£ G tZ} = 1}. 

Theorem 1.3 (Uniform exact LDP, lattice case). Let Y be lattice-valued 
with span d. Suppose that all of the conditions of Theorem 1.2 are satisfied 
except for (1.17). Instead, assume that there exists k G N such that 

(1.24) E\E[e is( - Yl+ - +Y ^\X 1 + --- + X k }\ <1 VsG(0,vr/4 

Taen t/fflt/i To > and as in Theorem 1.2 and {a} := [a] — a, as x — ► oo, 

0(ro)d e -^*(h'(To))-dT {z/i'(Vo)/<i} 



(1.25) Pr{W(x) >x/i'(r )} 



v /2vrx/i // (r ) 1 - e~ r o d 



To see the relevance of the condition to > 0, consider again the case where 
X and Y are independent, with EX > 0. Then by E[e tY ]E[e- h ^ x ] = 1, 
h'(0) = jjrg. By the strict convexity of h, /i'(to) > jjrg. As mentioned just 
before Theorem 1.2, this gives rise to a nontrivial LDP. 

Some comments on (1.17) are in order. One of its implications is that for 
any a, b G R and d > 0, Pr {Y G aX + b + dZ} < 1. Apparently, if E\E[e isY \X] \ < 
1, Vs 0, then (1.17) is satisfied with k = l. Another condition that implies 
(1.17) is as follows. 

Proposition 1.1. Suppose that X has a continuous density and that 
there exists a piecewise continuous function f on sppt(A) such that Y — 
f(X) is constant or lattice valued. Suppose that the graph of f is not a set 
of parallel straight line segments, that is, for any c£l, f{x) — cx is not 
piecewise constant. Then (X,Y) satisfies condition (1.17). 

Finally, in order to attain the uniform exact LDP, we need (ft(t) > 0. If 
X > 0, then it is easy to see that <p(t) > 0. The case where Pr{A > 0} < 1 is 
more involved. The condition (1.19) is imposed to ensure that in order for 
0(r o ) > 0. 

In what follows, Section 2 gives examples of application of the uniform 
exact LDP of W(x). In Section 3, Theorem 1.1 and its corollaries are proved. 
In Section 4, the main theorems concerning the uniform exact LDP are 
proved. Section 5 proves corollaries and related results for the uniform exact 
LDP. Section 6 collects auxiliary technical details for the main results. 



<s 



Z. CHI 



2. Examples. 

Example 2.1. Consider the example on neural activity in Section 1. 
Assume that the duration X of an epoch has density e~ x l{x > 0} and that 
within each epoch, the neural activity has the same dynamics. Specifically, 
let f > be a piecewise C 1 function on (0, oo) with / / > 0. Given an epoch 
of the form [77, r/ + X] , the point process £ therein is such that £ — 77 is a 
Poisson process with density f(t)l{t £ [0, X]}. Let Y be the number of points 
in the epoch. Then Y\X ~ Poisson(F(X)), with F(x) = Jq f. Suppose that 

lim^oo ^ = u > 0. Let VO) = jo°° e< F ^~ ux ^ dx. For any x > 0, is 
lattice-valued with span rf = 1. Define a = —00 if VK- 2 ) > 1 Vz G M, otherwise 
a = sa.p{z€R:ip(z) < 1}. 

We show the exact LDP (1.25) holds for tq > with e T ° — 1 > a. We need to 
check conditions (1) and (3) of Theorem 1.2, (1.16), (1.18), and (1.24). Con- 
dition (1) is clear. Given X = x > 0, E[e tY \X = x] = exp{F(x)(e* - 1)}. Let 
{x n } be the set of points where / fails to be C . Let $ be the density of X re- 
stricted to the exterior of a neighborhood of {x n }. Then condition (3) is satis- 
fied. Now V*G (0,tt], E\E[e lsY \X]\=E\e F ^ e "-^\=E[e F{ - x ^ coss -^] < 1. 
Therefore, (1.24) holds. 

For any s, E[e T ° Y - sX ] = b(s) := / °° e n^(e T o-i)-(s+i)x dx observe that 

b(s) is continuous and strictly decreasing on {b(s) < 00}. Since — > v as 
x — ► 00, for s > so := ^(e T ° — 1) — 1 > 1, b(s) < 00, and 6(s) — > as s — ► 00. On 
the other hand, as s j sq, T ^(e T ° — 1) and by e T ° — 1 > a, lim s j so 6(s) > 1. 
As a result, there exists a unique s = h(ro) > so with Z?[e Toy_sX ] = 1. It is 
then easy to see that there exists rj > such that E[e^ T0+v ^ '~ sX +v^j <- ^ 
Both (1.16) and (1.18) therefore hold. 

By (1.21), 0(t) = [(1 + /i(t)) / °° xe ^(^)(e*-l)-(/ l (t)+l)^ da-j-i for t > with 
e* — 1 > a. Now suppose that /(a;) = 1. In this case, a = —00 and W(x) is 
the number of points in [0, (x — X) V 0] from a Poisson process V{x) with 
density 1. We obtain h(t) = e — 1, 0(i) = e~* and h*{y) = uh\u — v + \ for 
t > 0, f > 1. For any T > 0, letting r = InT > in (1.25) yields 

-x{T\nT-T+l)-lnT{Tx} rp-\Tx\ JT-l)x 

Vr{W(x) > Tx} = ; . 

V^Tx(T-l) yfinTx{T-l) 

It is worth comparing the exact LDP of W(x) with that of V(x). For 
x S> 0, the "cut-off" interval [(x — X) V 0, x] is a very small fraction of [0, x]. 
Does the random cut-off have any effect? By Theorem 3.5 of [3], we have 

-x(A*)'(\Tx]/x) 1 

Pr{V(x) > Tx} = Pr{N(x) > \Tx]} ~ — , T > 1, 

where A x (t) = ~logE[e tN W] = e* — 1, A*(z/) = 2/lni/ - i/ + 1 for z/ > 1 and 

r x is the unique solution to A' x (t x ) = It follows that the effect can be 
quantified as Pr{y(x) > Tx} ~ TVi{W{x) > Tx}. 
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Now let Y = 1{X > M}, where M > is a constant. Then W(x) is the 
number of epochs in [0,x] with duration longer than M. Conditioning on 
X x + X 2 = u G (0, 2M), C = Yi + Y 2 is binary with Pr {C = 0} G (0, 1). There- 
fore, \E[e is ( Yl+Y2 ^\Xi + X 2 =u]\ < 1, Vs G (0,tt] and condition (1.24) is sat- 
isfied. For t > 0, s = is the solution to se Ms = e~ M (e t - 1). It follows 
that for any c G (e _M , jj), there exists a unique tq > with /i'(ro) = c. The 
exact LDP for Pr{VF(:r) > cx} can then be obtained. 

Example 2.2. Fix a > 0. Let X ~ iV(0, 1) and Y = 1{A~ > a} - 1{X < 
a}. Regard S n = X\ + • — \- X n as a random walk. Given x > 0, iV(a;) < oo 
a.s. and VF(x) is the difference between the number of steps with size greater 
than a and the number with size less than a before the random walk crosses 
x for the first time. Note that EN{x) = oo and hence that W{x) is not 
integrable. Let <&(x) = Pr {X < x}. For t > and s£K, 

E[e tY ~ sX ] = e s2/2 [e*(l - $(s + a)) + e~*$(s + a)] . 

V v ' 

A(t) 

Then h(t) = -^ln^ < is well defined only for t G (0,ln 1 f^ )- Now 

h{t) > 0x = lim a;_>oo ~ Pr { X > a;} — —cxd and condition (1.19) is satisfied. 
As in Example 2.1, W(x) satisfies the exact LDP in (1.25) with d = l. 

Example 2.3. Suppose that X and Y are independent, each has a C 2 
density such that EX > EY = 1 , ess inf X = ess inf Y = and 

t = sup{£ : £[e* y ] < oo} > 0, lim E[Ye tY ] = oo, 

t— >to— 

where ess inf X := sup{x : Pr {X > x} = 1}. Let £o = (0,0) and for n > 1, let 

&i = (£71,1,61,2) ■= (J27=l Xi, Td=l Yi). 

Given x > 0, let I x = [0,x] x [0,x]. Consider the probability that the first 
£ n outside I x is a certain distance from the upper-right corner (x,x). Let 
T(x) = mm{n : £ n <£ 1°}. Given A G (0, 1) and M G E, let A x , X) m = {£t(x),i < 
Xx + M}. Observe that, for < y < x, Ct(x),1 — V < ^ == ^ "f° r some k > 1, 

Eii ^ < y and Ef=i *i > ^ W(y) > x. 

As X > is nondegenerate, for t > 0, there exists a unique /i(i) with 

E[e tY - h ® x ] = E[e tY ]E[e- h ® x ] = 1. Then fc'(t) = |t, where a* = ^p^ 1 is 

strictly increasing and bt = E ^*-Ht)x\ " strictly decreasing. If h(t —) = oo, 
then as 1 1 to, f>t — > ess inf X = and hence h'(t) > I 2 - — ► oo. On the other 
hand, if h(tQ—) is finite, then as f f io? J5[e ] = g j e _j,( t )X] is bounded and 
hence, by E[Ye tY ] — > oo, /i'(i) > ^ — > oo. In either case, /i'(t) — > oo. Since 
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h'(0) = -f^ 7 — 1) there is a unique t\ with h'(r\) = j. So by Corollary 1.3, 
Pt{A XjX>m } = Pv{W(Xx + M) > x} 

±1- \ p Mh(rx) 

= Pr {W(Xx + M) > Xxh'(r x )} ~ ^ e -^(A-i) 

where 0(r A ) = ^^^-m^x^^ . 

3. Exponentially fast uniform convergence of renewal measures. This 
section proves Theorem 1.1. For any u-fimte measure p, let p denote its 
characteristic function. 

Proof of Theorem 1.1. Since N p = 1 + pN p and p = (1 — A p )<lp + 
Ap^p, following [25], Ap = (1 - Ap^)" 1 ^ + (1 - \ p )3> p N p ] and 

oo 

(3.1) iVp = (1 - Ap)«l>p *N p *N p + J2 = Qp + N p- 

n=0 



Because & p has a density <f> p £ Cq ((— T, T)) with T > independent of p and 
because 1 — A p > 0, Q p has a density q p £ C. Also, note that iV 3 



l 



We first show that (1.10) holds for 0<)"<1. By Ap^ p < p and 7 
su PpeA4 < 1j f° r an y e > 0, x > and pE M., we have 



A, 



7' 



p((-oo,-x]U[x,oo))<5p+ ^ A"<Sp + T _ 

n>ex ^ 

where 5 P = ^ n<ei Pr {| E"=i *i| > ^} with x i ' lA - d - ~ P- % (1-4), there 
exists r > 0, such that M T = suppg^ Ep[e T ' x '] < 00. Then by Chernoff's 
inequality, 

S P <J2 E p [e T< - nX - x) + e -T(nX+x)^ < 2exe :r{elogMT - T) . 

n<ex 

Thus, given e e (0, log ^ T ) , (1-10) holds for < r < min(elog ^ r — elogM r ). 

The rest of the proof is devoted to (1.9). We need a suitable spectral rep- 
resentation of q p (x). By A P (R) = , Xp = (1 — A p )$ p * A p is a probability 
measure. Then, as in [25], 



< 3 - 3 > s£l 8 ('"* , ^)*-5-^ oo »- 

For completeness, proofs for (3.2) and (3.3) are given in the Appendix. 
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Because sppt(3> p ) C [— T, T], the tail probability of Xp is the same as that 
of N p up to a shift bounded by T and a multiplicative factor bounded by 
I-7. Then by (1.10), 

(3.4) sup {e rx x P ((-oo,-x] U [x,oo))} < 00 V0<r<l. 
x>o,peM 

By condition (1.3), (3.2)-(3.4) and the self-conjugacy of x p (0) and p(9), 

1 1 

(3.5) q p (x) = \ 27r 

— I p (x) + Rp(x), ifx<0, 

with sup x>0peM \e 5x R p (x)\ < 00, where 

1 1 



(3.6) I p (x) = e-^Xp{0)Kp{9) M, K p (z) := 

To continue, we need the next lemma, which will be proven in Section 
6.1. 

Lemma 3.1. There exists 77 > such that for allp£ M, p{z) := E p [e tzX ] 
is analytic on D v = {z: < 77} and p(z) 7^ 1 for z 7^ 0. Furthermore, 

L v := sup zeDrj peM \K p (z)\ < 00. 

Let Ap(s) = \pje s *%(dx). By (3.1), \N P (9 - is)\ < J2%Lo A p (s) n , s G 
Given s G (— r, r), since < & sx \ — 1 < |sx|e' s:c ' < 



,,T|.r 



T-\S\ ' 

0<A p y" e l sa % p (dx) - A p < y"(el sx l - l)p(dx) < , 

yielding < A p (s) < A p + ^ztjt ■ Thus one can choose < 77 <C 1 as in Lemma 

3.1 such that sup^g^ j s i <r? yLj(s) < 1. As a result, N p (z) are analytic and 
uniformly bounded in D v . By means of some computation, 

(3.7) \$ p (6-is)\ <e |sT| min(l,C#~ 2 ) V#, s G K,p G M, 

where C = sup^g^ f \4>p\- It follows that Xp = (1 ~~ A p )$ p iVp is analytic in 
I},, and (1 + 9 2 ) swp pe j^ \ s i <ri \x p {0 — is)\ < 00. Thus there exists a constant 
C\ > such that Jf^ |x p (0 - ^01 d0 < Ci for s G [-77, 77] and p£ M. 

Let r G (0,77). By Lemma 3.1, K p (z) is analytic on D r . For x > 0, apply 
Lemma 3.1 and Cauchy's contour integral to e~ %zx x P { z )K p {z) along the path 
Q(z) = and Q(z) = —r. Then by (3.6), 

/oo 
e- x( - r+l6) Xp (0 - ir)K p {9 - ir) d9 
-00 
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and hence < L r e xr J^lXpi^ — ir)\d6 < C\L r e xr . Similarly, for 

x < 0, \I p (x)\ < dL r e xr . So by (3.5), (1.9) holds. □ 

Proof of Corollary 1.1. For peM, Z p (x) = J^° 00 z p (x - y)N p (dy) 
is a solution to (1.11). For x > 0, 

/oo roo 
z P (x - y)N p (dy) +/ z p (x - y)q p (y) dy 
-oo J —oo 

/ z p (x-y)dy 

Hp J —oo 

and hence 

roo r x /2 

\Zp(x)-u p \< \z p (x-y)\Np(dy)+ I \z p (x - y)\N p (dy) 

Jx/2 J -co 

poo 

+ / \z P {x - y){q p {y) -Hp l )\dy 

Jx/2 
rx/2 

+ / \z P (x - y)\(q P (y) + Hp )dy. 

J —oo 

The integrals on the right-hand side are bounded by LA2e~ rx / 2 , LA2e~ r,x / 2 , 
LAie - ™/ 2 and ^L(A\ + -jj-)e~ vx / 2 , respectively. A similar bound for x < 
can be obtained. Therefore, Z p satisfies (1.12). 

It remains to show that the solution is unique for each p. If sppt(p) £ 
[0, oo), this follows from [5], Lemma 4.1.1. In general, let D(x) be the differ- 
ence between two such solutions. Then D(x) = D{x — y)p n *(dy). Given 
e > 0, there exists C > such that D(x — y) < Ce £ ^ x ~ v ^ and hence |-D(x)| < 
SZo Ce<X ~ v) P n *( d y) =Ce £X {Ep[e- £X )) n . By (1.3) and (1.4), E p [e~ eX ] < 1 if 
e<l. Letting n — > oo yields -D(x) = 0. The uniqueness is thus proved. □ 

Proof of Corollary 1.2. The uniqueness of the solution to (1.13) 
can be shown by following the proof of Corollary 1.1. Let Z p (x), x > 0, be 
the solution. Extend Z p {x) and z p (x) to M so that for x < 0, Z p (x) = and 
z p {x) = — ^ ^ p (x — y)p(dy). Then the renewal equation 

/oo 
- y)p{dy) 
-oo 

holds. By (1.4), for x < 0, |z p (x)| < /f ^ L 2 (v)e^ x ~ y ^p(dy) < L 2 (r])e^ x M T . 
Thus sup a . €K>p6>( {e'?l a: l|^(a;)|} < L. By Corollary 1.1, (1.15) holds. □ 

4. Uniform exact LDP. This section proves Theorems 1.2 and 1.3. We 

start with some basic results. 
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4.1. Preparations. By condition (1.18), 

<p(t, s) := E[e tY+sX ] e C°°((t, s):\t- r | < rjo, \s + h(r )\ < rjo)- 

Then f(s) := (p(r ,s) E C°°, f(-h(r )) = 1. By condition (1.16), inf / < 1. 
As /i(to) = — sup{s:/(s) < 1} and / is convex, f'(—h(ro)) > 0. Therefore, 

Mro,-h(T )) = ToY _ h{To)x > ^ 
ds 

Fix ro and rjo as in Theorem 1.2. By the implicit function theorem (cf. 
[20]), there exist < £o < to A rjo and < rj < (h(ro) — j3x) A rjo such that h 
is a smooth mapping from Iq = [ro — £o ; To + £o] m to [/t(ro) — rj, h(ro) + 77] , 

(4.1) E[e tY-h{t)X] = 1 
and 

(4.2) £[AV y+sX ] = > on /o x [-fcfo) - r), -h(r ) + rj\. 

OS 

Differentiate E[e tY ~ h ^ x ] = 1 twice to obtain h"(t) = MQ^^gg^fl , 

By condition (1.17), /i"(i) > and hence h(t) is strictly convex on Jo- 
By (4.1), for any t £ Iq, define the following probability measure: 

P t (dx,dy) = e ty - h ^ x P(dx,dy). 

Denote by Et the expectation under Pi and by E that under P. Then 
E t [X] = E[Xe tY ~ h ^ x ] and sup teJo E t [X] < 00. Under P u the marginal of 
X and the conditional measure of Y given X are, respectively, 

Ft(dx) = g x (t)e- h ^ x F(dx), 

(4-3) 

P t (dy\x) := P t (dy\X = x) = -^-P(dy\x). 
Note that for any function /, E t [f(X)] = E[e tY ~ h ® x f(X)]. Define 

(4.4) Mt) = eHt)x , Mt) = ~Mt^, k ^) = -M^- 

Then Ft(dx) = k x (t)F(dx). To apply Corollary 1.2 to the proof of Theorem 
1.2, the following lemmas are needed. 



Lemma 4.1. The family of probability measures {F t (dx),t G Jo} satisfies 
conditions (1.3)-(1.8). 



14 



Z. CHI 



Lemma 4.2. For all x > and t G J , M x (t) < oo. Define 

(4.5) A*(f) = - log Af^i), A* x (\)=sup{\t-A x (t)} 

and define (f>(t) by (1.21). Then there exists I = [t — e, t + e] C Ig 
e G (0, £o A t ) such that inf fe / h"{t) > ; 

(4.6) limsupsup{j;|A(. n) (t) - /i (n) (t)|} < oo, n = 0,1,2, 

and 4>(t) is continuous on I , ini t£ j <p(t) > 0, and there exists a > such that 

(4.7) limsupe ax sup \ cp x (t) - cp(t)\ < oo. 

In the following proofs, the uniform exact LDP in [3] is the fundamental 
tool. However, it turns out that some of the conditions used in the main 
result of [3] are hard to verify for W(x). We shall instead check the more 
basic conditions provided in that work. 



4.2. Nonlattice case. Proof of Theorem 1.2. Let / be as in Lemma 
4.2. To prove (1.20), it suffices to show that for any x n — > oo and r n G 
(T -e/2,T + e/2), 



(4.8) Pi{W(x n )>x n h'(T n )} 



T n yj2lTX n h"(T n 



-x n h* (h' (r n )) 



n — > oo. 



For brevity, define M n {t) = M Xn (t) and cp n {t) = 4> Xn (t). Let A n (t) = ± x 
logM n (i) and v n = h'(r n ). Note that a := inf/ h"(t) > 0. By (4.6), 



C := — limsup 

2a n 



x n sup\A' n (t)-h'(t)\ 
tei 



< oo. 



Let e n = For n > 1, T n ±e n e I and hence A' n (r n + e n ) -v n > A' n (T n + 
£n) - h'{r n + e n ) + ae n > 0. Likewise, v n - A' n (T n - e n ) > 0. Since is 
strictly increasing, there exists a unique i* G / with 

(4.9) A' n {t* n )=v n , \t n -T n \<C/x n . 

Define random variables A* n and U n such that 

Pr {A * n G — z n i/ n } = 6 ^ { ^ } Pr { W(x n ) G dn} , 



On 



M n (t* 
4* 



V x nA"(tn) 
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We will later show that there exist 5 > and N > 0, such that 
(4.10) 



f*(s) := sup{|£[e^"]|l{| S | < 5yJx n A»(t* n )}} G h\ 

n>N v 



1 



Vr/,A>0. 



(4.11) sup 

»?<|s|<A M n(*J 

Equation (4.10) implies (2.7) in [3]. Meanwhile, it can be shown that 

U n iV(0, 1), which is the first conclusion of Lemma 3.1 of [3] (cf. [6], 
Theorem 3.7.4). Thus the first claim in the proof of Lemma 3.2 of [3] holds. 
As < liminf t* < limsupt* < oo, t* n satisfies (3.3) in [3] and (4.11) implies 
condition (c) of Lemma 3.2 of [3]. Thus that lemma holds for W(x n ). By 
Theorem 3.3 of [3], 

g %n A n (Vn ) 

Pr{W(x n ) > x n v n } ~ 



n 



oo. 



B y ( 4 - 6 )> W) 



tZy/2TTX n A»(t* n y 

1. Note that e -*» A nK) = e -^(""*n-''(^))0 n (t* ). Since 
G C(7), by (4.7) and (4.9), lim<£ n (i*) =4>(t ). By Taylor expansion, 
^n*n ~ KK) = ~ h ( T n) - \h"{£ n )(t* n - T n f 

= h*(v n ) - \h"(^ n ){t* n - Tnf, some i n G [r n ,t*]. 
By (4.9), v n t* n - h{t* n ) = h*(v n ) + o(x~ 1 ) and hence (1.20) is proved. □ 

4.3. Lattice case. The proof for this case is based on the next lemma. 

Lemma 4.3. Under the assumptions of Theorem 1.3, for all x ^> 1, 
W(x) is lattice-valued with span d. 

Proof of Theorem 1.3. As in the proof of Theorem 1.2, the bound 
in (4.10) still holds. On the other hand, following an argument similar to 
that in the proof for (4.11), it is not hard to see that for any r\ G (0,ir/d], 

E r e (tl+is)W(x)-\ 



sup 

ri<\s\<iz/d 



The rest of the proof follows that of Theorem 1.2. Let v = h'(ro) and 



d r^r] . As \u x - v\ < | , Mx > 0, there exits a unique t* with h'(t%) = v x . 



x I d 



By Theorem 3.5 of [3] 

Pr {W(x) > xu} = Pr<{ W(x) > d 



xv 
~d 

Pt{W(x)>xv x } 
v/2vrxAj;(^Jl-e-^ d ' 
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By \h'{t%) - ti(r )\ = \v x - v\ < f , there exists C > with \t* - r | < f . 
Then A"(C) -> /i"(r ), e"^^) = e ~<^%-^%)) = e -*(yxiZ-M&)) <j) x (t* x ) ~ 
e -x(i/«fS-hK))0( 7l) ) and 

i/ z t* - fc(£*) = (1/3; - - r ) + (z^ - v)t + i4* - 

= iy x - u)tq + ut - h(r ) + 0(x~ 2 ). 

Finally, note that x{y x — v)tq = dT${xv / d} . This then completes the proof. 
□ 

4.4. Uniform bounds for the tilted complex moment generating functions. 
The rest of the section is devoted to (4.10) and (4.11). Let a n = \/A"(i* ). 
Then 



E[e zUn ] =exp|- 



UnV ^ Z} -M n (t* n + ^- 



0~n J M n (t^) V 

\fx~nO n 



ax n a1s 2 



Proof of (4.10). The formula will follow if there exist a, 5 > such 
that 

limsupsup{|£[e isl/ "]|l{|s| < 5^fx~a n }e as2 } < oo. 

n s£R 

Replacing s with y/x^,a n s, the supremum becomes 

(\M n (t*+is 

SU P S TT-, T— e 

As i* £ / and A"(i*) is bounded away from and oo, (4.10) will follow if 
there exist a > and 5 > such that 

(\M x (t + is)\ axs2 \ 
hmsup sup < J — e > < oo. 

z->oo te/,|a|<5l Mr(i) J 

Note that M x (i) = (j) x (t)e h ^ x . Let G a; (t + is) = e -M*)*£[ e (*+fc)W(aO]. By 



Lemma 4.2, supj | — 1| — > and inf/0(£) > 0. Thus it suffices to show 
that 

(4.12) limsup sup {\G x (t + is)\e axs2 } < oo. 

x^oo t£l,\s\<8 

Define w fc = £?=i«i- By (4.3) and (4.4), for s,t€l, 
G x (i + is)=Vx(t)+ / X ^[e^lulG^Ct + wjFtCdu) 

J — oo 

oo . n 

= Y, / ^-«„(t)lH < x, VA; < n} n £ t [e isy l^i^efe 

n=0 i=l 

J n (s,t,x) 
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Note that \ J n (s,t,x)\ < J n (t,x) := J n (0,t,x) and S n > J„(t,i) = G x (t) = 
(f>x(t)- First, we show that there exist 7] > and M > such that 

(4.13) lim sup e vx < sup E | J n (t,x)\ + sup E | J n (i, x)| > < oo. 

X ^°° l te/ n<r,x ^ n>Mx J 

By (1.18) and inf jh(t) > fix, there exists a G (0, ^(inf/ /i(i) — fix)) such 
that 

L :=suplog^[e 2a|x| ] < oo, 



K(i/>):= sup |e^Vx(t)| <oo. 

tG/,x>0 



Then 



„ n 

|Jn(i,x)| <#(V0 / e-^-^n^C* 

i=i 

< K(^) e - 2aa; (£ 4 [e 2aX ]) n . 
Fix 77 G (0, f ). Then for all t G /, 

E \Jn(t,x)\<K(iP)e- 2ax J2 E ti e2aX ] n 

n<r\x n=l 



< 



K ^ e -2ax+L V x ^ K(i))e- ax 



On the other hand, by the selection of /, it is seen that there is b > 0, 
such that I := sup tg I log E t [e~ bX ] < 0. By Chernoff's inequality, for n > 1, 

\J n (t,x)\ < K(^)P t (pXj <x^< K^)e hx E t [e- bX ] n < K^)e bx+ln . 

By choosing M>0, (4.13) is thus proved. 

Let A x = [r]x,Mx]. We need to bound J2 n £A x Jn(s,t,x). For n > r/x, let 

/n 
il> x - Wn (t)l{w k < x,Vk G {r]x,n}} ]J E t [e isY \ Uj }F t (d Uj ). 

j=l 

With the same a > and L > as in the bound for Yln<m \Jn\, for t G /, 

/n 
ipx-w n (x)l{w k >x,3k< rjx} Y[ F t {duj) 

T]X / k \ 

(4.14) <KW^P t ^I,^ 

fc=i \j=i / 
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IfX 



kL 



k=l 



l-e~ 



We next find an a > such that sup tg/ J2neA x J'n{ s i x) = 0{e axs2 ) and 
then use the above approximation to bound sup teI J2Jn(s,t,x). Note that 



Uj). 



J' n {s,t,x) = / J n _i vxi (s,t,x-wi nx j)Y[E t [e lsY \uj]F t (d 

3=1 

Fix fc as in (1.17). Let ^ = Ej=i^j> ^ = E^=i^i- In ord er to obtain 
the desired bound, we express J^(s,t,x) in terms of E t [e is t\Z]. By (1.17), 
for each t G 7, i% | £7 t [e is5 1 Z] | < 1, implying that E t [a z (t)] > 0, where a z {t) = 
Yaxt{i\Z = z). Note that if a z {t) > for one t € 7, then by the smoothness of 
Pt, v(z) := inft e j c 2 (t) > 0. Therefore, Pr {t> (Z) > 0} > 0. On the other hand, 
by (1.18), sup t6 j E[e^ +T1 ^ \Z] < oo a.s. Thus there exist r > and R > 1 such 
that p := mi t€l P t (Z £ T) > 0, where T = -{> : r < v(z), sup teI E t [\£\ 3 \Z = z] < 

R}- Let m = L^J , Zj = E*=i ^0-i)fe +s) & = E*=i Then 
J' l (s,t,x)= i J k (s,t,x-wi vxi )\ 

n€A x J \k<(M-r])x I 



V 



xl[E t [e i ^\Z j = z j )Ft(dz j ) 

3=1 

x I] ^[e isi1 |^ = %]^(rf%). 



j'=mfc+l 

Since |V| < £ ^fc(*, x - w [vxi ) = (j>x-w ]jm] (*) < sup^ ^(t), 



(4.15) 



n£A x 



'x-w lvxi 
m 



< 



sup^(t) / n / / * 



< sup x (t) 



t.a: 



l-p + pBup\E t [e ia t\Z = z]\ 
zer 



By Lemma 4.2, sup t x cp x (t) < oo. Let m(z) = E t [£\Z = z\. Then by [2], 
Proposition 8.44, for \s\ < 1, z € T and t G 7, 

|£t[e is «|Z = z]| = |^[e is( «-^ (2)) |Z = z]| 
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Because — — ► 5 as x —> oo, it is seen that there exists a > such that for 
|s| <C 1 and i»0, | SneA J' n {s,t,x)\ < Ce~ axs2 , with C > an unspeci- 
fied constant that may vary from appearance to appearance. Together with 
(4.14), this implies that | £ reeAc J n (s,t,x)\ < C{xe~ ax + e~ axs2 ). Then by 
(4.13), there exists S > such that for \s\ <S,t£ I and i>0, \G x (t + is)\ < 
C{e~^ x + xe~ ax + e~ axs2 ). This then completes the proof of (4.12). □ 



Proof of (4.11). The formula will follow if sup teIri< \ s t <x \G x (t+is)\ = 
o(x~ 1 / 2 ), where G x (-) is defined as in (4.12). From the proof of (4.10), 
su PteLri<\s\<x\ G x{t + is) - EneA, =0(e~ ax ) for some a > 0. On 

the other hand, from (4.15), we obtain | J2neA x ^n( s ^ ^,x)\ < Cf(s) vx / k , where 
C is a constant and f(s) =sup teI E t \E t [e i ^\Z]\. As E\E[e is ^\Z]\ < 1, it can 
be seen that f(s) < 1. The proof then follows. □ 



5. Consequences of the uniform exact LDP. 



Proof of Corollary 1.3. Let v = /i'(t ). For x>0, there exists a 
unique t x G / with h'(t x ) = v x := ^ l a fe . As t x — > tq, by the uniform conver- 
gence, 

Vy{W(x + a) > a^' (to) +&} ^ e -("+ Q ) fe *(^). 

t x ^/2irxh"(t x ) 

Since t x -> r > 0, — JM= = (1 + (1)) / (ro) = . On the other hand, 

-(x + a)h*(v x )+xh*(v) 

= x[h*{v) - h*(u x )] - ah*(v x ) 

= h*'(z) X< " aU ~ b>> - ah*(v x ) -» h*'(u)(au - b) - ah*(u), 
x + a 

with z = z(x) between v and v x . Since h*'{u) = tq and /i*(z^) = ito — h(ro), 
the limit is ah(ro) — br$. This then completes the proof. □ 



Proof of Corollary 1.4. Use the same g x (t), k x (t) and F t (dx) as in 
the proof of Theorem 1.2. On the other hand, define 

M x (t):=E[e™(% - M * {t) 



e 



h(t)x ' 
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As in the proof of Theorem 1.2, let M n (t) = M Xn (t), A n {t) = A Xn (t) and 
Pr{A* G du - x n v n } 

Un 

Clearly, Lemma 4.1 still applies. The proof then follows from Lemma 5.1 
below and almost the same steps as in the proof of Theorem 1.2. □ 

Lemma 5.1. Under the conditions of Corollary 1.4, Lemma 4.2 still 
holds if A x (t), (f)x{t) and (f)(t) are replaced by A x (t) = ^ log M x (i) , 4> x (t) and 
(f)(x), respectively, and equations (4-10) and (4-H) still hold if M n (t), A n (t) 
and U n are replaced by M n {t), A n {t) and U n , respectively. 

Proof of Proposition 1.1. Let the span of Y — f(X) be d. Since 
X has a continuous density, each connected component of sppt(X) has a 
nonempty interior. We first show that if f{x) is continuous but not affine on a 
nonempty (a, b) C spptpf), then (X,Y) satisfies condition (1.17) with k = 2. 
Let (£i,Ci) an d (£,2,(2) be independent, such that Pr{£j G dx] = Pr{X £ 
dx\X £ [a,b]} and Pr{Ci G dj/|& = x} = Pr{Y £ dy\X = x}, Vx £ [a,b]. It 
suffices to show that 

(5.1) E\E[e is ^ + ^x + ^]\<l 

Assume that (5.1) is not true for s / 0. Then for a.e. u £ (a,b), there 
exists h such that Pr{£i + C2 G h + ^%>\€i + 6 = 2u} = 1. Since Ci + C2 G 
/(6) + + a.s., Pr{(/i + JLZ) D (/(&) + /(&) + dZ) + 0|6 + 6 = 
2u} = 1, implying that for a.e. x G (2ii — b, 2u — a) n (a, 6), /(2n — x) + f(x) £ 
h + + dli. Since f(2u — x) + /(x) is continuous in x and + dTL is 
discrete, there exists c such that /(2k — x) + /(x) = c. In particular, letting 
x = u yields c = 2f(u). It follows that for x,y £ (a, b), f(x) + f(y) = 2/(^^) 
and hence / is affine on (a,b), a contradiction. 

It remains to show (5.1) for the case where / is piecewise affine. By the 
assumption, there exist disjoint intervals (ai, 61), (02, b 2 ) C sppt(X) and con- 
stants c\ 7^ c 2 , di and d 2 such that /(x) = qx + dj on (aj,&i). Let (£1,(1) 
and (£2^2) be independent such that Prj^ £ dx} = Pi{X £ dx\X £ Ij} and 
Pr{0 £ dy\£i = x} = Pr{Y £ dy\ X = x}. Now sppt(£i +6) = J =[ai + a 2 ,b 1 + 
b 2 }. Given 6 + 6 = u £ J°, Z := /(&) + /(&) = (<* - c^n + c x u + d ± + d 2 , 
where Pr{r/ G fix} = Pr{£ 2 G dx\& G J} = Pr{X G dx|X G I}, with I=(u- 
b 2 ,u-a 1 ) n (a 2 , 62) / 0- Thus Z has a density, yielding ^[e^+^lfi + £2 = 
u}\ = \E[e isZ \£ 1 +& = u} \ < 1 for all □ 



exp{t» 
M n (t* n ) 
4* 



Pr{W(x n )Gd«}, 
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6. Auxiliary technical details. 

6.1. Proofs of auxiliary results for the renewal measures. 

Proof of Lemma 3.1. By condition (1.4), p(z) = E p [e lzX ] are analytic 
and equicontinuous in D T . Fix ro G (0, r). Let fL p = E p \X\ and v p = hE p [X 2 \. 
For z with \z\ < ro, 

00 I ,|n p I V" In 

\p(z) -l-HpZ-v p z | < 2^ -i 

71=3 

(6.1) =E[e lzXl ] - 1 -/2 p |z| - v P \z\ 2 

< E p [\X\ 3 e r ° m ]\z\ 3 <CM T \z\ 3 , 

where C > sup x>0 x 3 e^ r °~ T ^ x . By (1.4), sup p v p < oo. Combined with (1.3), 
this implies that there exists 5 > such that \p(z) — 1| > S\z\ if |3i(z)| < 5 
and \%(z)\ <5. 

Assuming the first statement in Lemma 3.1 were false, there would be 
t n — > 0, 6 n E R and p n E A4, such that 6> n — it n 7^ and p n (# n — ii n ) = 1. 
From the previous paragraph, |# n | > 5. Then by \p n (9 n — it n ) — p n {&n)\ — 
^ P „[e |tnX| ] - 1 < M]* n|/r -1^0, p n (0 n ) -> 1. On the other hand, by (1.6) 
and (3.7), p n (6 n ) = (1 - X p )%(9 n ) + A p * p (0 n ) < C6~ 2 + 7. Therefore, 
liminfC#~ 2 > 1 — 7 > and the 9 n are bounded. By (1.4), M is tight. 
Then there exist a probability measure po an d an such that, say, 

Pn —> Po and # n — ► s. Note that |s| >5. Because p are equicontinuous on D T , 
by Pn(Gn — it n ) = L we obtain po(s) = 1. Therefore, po is concentrated on a 
lattice L of span |s|. 

Given e > and 77 > 0, let L £ = \J xeL (x — e,x + e). There exists R>T such 
that p n ({-R,R)DL £ ) > 1 -77, Vn> 1. Then by (1.5), (1.6) and sppt($ p ) C 
(— T, T), 

(6.2) 7+ sup $ p ((-T,T)nL e )> I-77. 



Because 4> p E Cvj((-T,T)), from sup X)1/ |^(a;) - 0p (y)| < /5tI0p I 
0,1, we obtain A :=sup peA< Halloo < 00 and by (6.2), 7+A£((-T, T) nL e ) > 
1 — 77. Letting e — ► yields 7 > 1 — 77. Since 77 is arbitrary, we arrive at a 
contradiction to (1.6). This proves the first statement in Lemma 3.1. 
To show that L r] < 00 for some 77 G (0, r), given p£ M, 



1 



\K P (z)\ 



1 1 



1 — i\i p z\ 



H p \p{z) - l\\z\ 



l-p(z) -i/jLpZ 

By (6.1), \p(z) - 1 - ifipz] < v p \z\ 2 + CM T \z\ 3 and \p(z) — 1| > 77 p |z| - 
z/plzj 2 + CM T |z| 3 . As infpyUp > and sup p f p < 00, there exists 5 > with 
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su PpeM,\?Rz\,\<3z\<6 \Kp( z )\ < 00 • Thus if = 00 for any 77 G (0, r), then there 
exist t n — > 0, # n G R and p n £ M such that |0 n | > 5 and p n {0n — it n ) — 
1 — ► 0. The same argument for the first statement then applies to yield a 
contradiction. This completes the proof of Lemma 3.1. □ 

6.2. The moment generating function of the random sum. This part pro- 
vides technical results on M x {t) for the proof of Lemma 4.2. Recall that 
Px = lim sup x ^ log Pr {X > x} . 

Lemma 6.1. The following statements (l)-(4) are true. (1) For any t 
with T>t 7^ 0, E[e tY ~ sX ] is strictly convex in s G Vt- Furthermore, given 
tx,h and A G (0, 1), we have (1 - X)V tl + XD t2 C £ , (i_A)t 1 +At 2 - ( 2 ) ^ or an ^ 
i£l, T>t is a closed interval and h{t) > —00. In particular, if h(t) < 00, 
then h(t) G V t . (3) h is convex in A={t £R:h(t) < 00} and h(0) = 0. (4) 
A is an interval with G A. In particular, for any t G A, if V° 7^ 0, then 
V°^0, Vs£A°. 

Proof. (1) follows from the strict convexity of e x , the assumption that 
X is nondegenerate and Holder's inequality. (2) By (1) and Fatou's lemma, 
V t is a closed interval. If h(t) = -00, then for any M > 0, E[e tY+MX ] < 
1, implying that ess sup X < 0, which contradicts (1.1). (3) By (1), h is 
convex. Clearly, h(0) < 0. If h(0) < 0, then E[e\ h ^ x ] < 1 and by the strict 
convexity of E[e sX ], there exists a > such that E[e aX ] < 1. For x S> 0, by 
Chernoff's inequality, £Pr{£™ =1 X; > x} < e~ ax J2(E[e aX ]) n < 1, implying 
that Pr{7V(x) = 00} > 0, which contradicts (1.1). (4) follows easily from (1). 
□ 



Lemma 6.2 [Upper bound for exponential rate of M x (t)]. Let t £ R be 
such that (3x < h(t) < 00 and V° 7^ 0. Then M x (t) is rightcontinuous in 
x > and for e > with h(t) + e £ V°, there exists K £ > such that 

(6.3) M x {t) < K £ e {h{t)+£)x Vx>0. 

Furthermore, if either h(t) > or e < \h(t)\, then one can set K £ = fr^^y, 
where H(a) = E[e^ 0Aa ^ x ] + 1 and p(t,e) = E[e tY -^ +£ "> x \. 



Proof. For brevity, define a" = YA=i a i- First, suppose that h(t) > 0. 
Fix e > with h(t) + e£ V° t . By Lemma 6.1, E[e tY ~( h ® +e ) x ] < 1. Then 
00 00 
e tw(*) = £ e tY "l{N(x) = k}<J2 e tY "l{X^ < x} 

k=0 k=0 

6.4 

00 00 
< J2 e tY ^ k e {h{t)+e){x - x ^ = e {h(t)+£)x V 

fc=0 fc=0 
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where £ fc = n*=i exp{tYj - (h(t) + e)X j }. Let Q x = e (M*)+e)* £ Then 

oo 

(6.5) E[C x ]=e^+^J2P^ £ ) k <°°- 

k=0 

Equations (6.4) and (6.5) show that M x (t) < K e e^ +e)x and, given x > 0, 
e tw(x) < ^ Vx G ( ,x ). When y | x, N(y) j JV(sc) and W(y) -» a.s. 
Then by dominated convergence, M x (t) is rightcontinuous in x. 

If /5 X < < 0, then we show that for < e < -h(t), E[e-^ + ^ x ] < oo. 
Fix6e(0,h(t)-(3 X ). For x> 1, Pv{X > x} < e -(\h(t)\+S)x _ Then 

roo roc 

/ e- {h{t)+£)x F(dx) < / e- h{t)x F(dx) 
Jo Jo 

roo 

<l + \h(t)\ e lh ^ x Pi{X>x}dx<oo 
Jo 

and hence E[e~( h ® + ^ x 1{X > 0}] < oo. On the other hand, because h(t) + 
e < 0, E[e~^ + ^ X 1{X < 0}] < 1. Therefore, E[e~^ + ^ x ] < E[e~ h V x } + 
1 < oo. Fix e G (0, -h(t)) with h(t) + e G Then 

oo oo 

e tW(*) = £ e ^ fe i { Ar (x ) = A;} < ]T e tr il{lf +1 > x} 

fc=0 k=0 

oo 

(6.6) < ]T e tY* e -(h(t)+z){xi +1 -*) 

k=0 

oo 

= e (h(t)+e)x y> ^ fce -(h(t)+e)X fe+1 _ 
fc=0 

Note that £ n is independent of . An argument similar to that for h(t) > 
can then be applied. The expression for K e follows from (6.5) and (6.6). 

□ 

Lemma 6.3 [Upper bound for exponential rate of M x n \t)]. Suppose that 
there exists I = (a, b) such that fix < hit) < oo on 7. Also, suppose that there 
exist t£I andr]>0 such that V°^0 and E[e tY ~ h ^ x+ ^ x ^ Y ^\ < oo for 
t G 7. Then for any x > 0, M x (t) G C°°(I) and there exists K = K(n,t,e), 
such that 1 } | < Ke^ +e >, Vt G I, e > 0. Furthermore, ifh{t)+e G V° t 
and either h(t) > or e < |/i(i)|, f/ien one can set K = H(h(t)) x H\(h(t)) x 
P n (p(t,e)) x (1 — p(t,e))~ n , where H(-) is given in Lemma 6.2, H\{a) = 
C^[e*^~ ^w^+'KI- x 1+f I)] TOf/i C an absolute constant and P n a polynomial 
of degree n with absolute constant coefficients. Finally, d g^f G C(/ X E). 

Proof. Because V° / 0, by Lemma 6.1, 2?° / 0, Vi G 7. Then by 
Lemma 6.2, Vx > 0, M x (t) < oo on 7, implying that M x (i) G C°°(7) with 



24 Z. CHI 

Mi n \t) = E[W{x) n e tw{ -% For n > 1, by \Ei=i*i\ n < k^ELi N", if 
h(t) > and < e < 1, then, as in (6.4), 

oo / k \ 

\ W (x)\ n e tw{x) < e Wt)+£)x J2 fcn_1 J2 

k=0 \i=l / 

Let C = sup x > x n e-^ and & = Ce tY ^ h ^ x ^ x ^ Y ^ . Since C; are i.i.d. 
with ECi < oo and |Y;| V^-W*) 4 *)* 1 < Ci, we have £[|W(x)| V^*)] < 
Ke (h(t)+e)x^ where ^ = J ECiEfclifcX^e) fc " 1 - The case < /i(t) < is 
proved likewise. The rest of the proof follows that of Lemma 6.2. □ 

Lemma 6.4 [Exact exponential rate of M x (t)]. Suppose that fix < hit) < 
oo and E[e tY ~ h( ~ t)x ] = 1. Suppose that either (1) Pr{X>0} = 1, or (2) 
V° t / and E[e q(tY -(° Ah (W>\X > 0] < oo, Vg > 0. TTien ilogM x (t) -> 
h(t). 

Proof. By Lemma 6.2, we have limsup - log M x (t) < h(t). It remains 
to demonstrate that liminf - log M x (t) > /i(t). First suppose that (1) is true. 
Then T>t = [h(t), oo) 7^ 0. Assume that the lower bound does not hold. Then 
there exist e > and z n — ► 00 such that /(z n ) := ( ^1^ Zra — > 0. Fix ?/ n j 0. 
Then x n := sup{x : Vu G [0, x), f(u) > rj n } < 00 and 

/W > ^ J^u f&n - u ) F ( du ) ^ VnE[e Z l{X G (0,x n ]}], 

where Z = tY — (h(t) — e)X. Since M x (t) is rightcontinuous, f{x n ) < r/ n 
and hence E[e z l{X G [0, x n ]}] < 1. Note that x n is increasing. If x n f 00, 
then E[e ] < 1, contradicting the definition of fo(i). If x n — > z < 00, then 
M Xn (t) = /(x n )eW t )- 6 ) !B » -> 0, that is, ^[e* 14 ^™)] -> 0, which implies that 
Pr{|W"(x n )| > M} — ► 1 for any M > 0. However, since iV(^) < 00 and \Y\ < 
00 a.s., this is impossible. Thus the lower bound holds. 

Suppose that (2) is true. Let U n = exp{ty n — h(t)X n }, Z n = U\ - ■ -U n and 
T(x) = N(x) + 1. Fix e > with h(t) + e G V° t . Define \ n as in (6.4). Then 

Z n l{T(x) =n}< Z n l{T(x) > n} 

n _. 
< 11 e tY k -h(t)X h x e e(x-J2ti X «) = e £X Cn-lU n . 
k=l 

Since E[£ n -i] = p(i,e) n_1 and E[U n ] = 1, with p(t,e) < 1 defined as in 
Lemma 6.2, there exists M > 1 such that for x 3> 1, £ , [Z T ( 2 ,)l{T(x) > 

Mx}] < i. Let X* = X*(x) = YZ?Xi - x, Q = ((x) = ^e'^j-W . 
Then 

E[e tw ^(] > ^—E\e tw ^e tYT ^)- h ^ x *l{T(x) < Mx}} > ——. 
L SJ ~ Mx 1 1 v ' 11 ~ 2Mx 
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Fix p, q > 1 with ± + ± = 1 and pt G -4°. Then B^ 1 )] 1 /^^]!/? > ^J^. 

Note that M^pi) = E[eP tw{ -% Also, note that < X* < X n if T{x) = n. So 
by the assumption, E[C] < J2n- q E[e^ tYn -^ A0 "> Xn h{X n > 0}] < oo. Thus 
liminf ^log M x (pt) > h(t). Replacing pt by t, we get liminf ^log M x (t) > 
ph(t/p), Vi G A°. Let p 1 1. Since /i(i) is convex and hence continuous in A°, 
the lower bound follows. □ 



6.3. Proofs of auxiliary results for the uniform exact LDP. 



Proof of Lemma 4.1. Recall the definition of Lq and 7] > given just 
before (4.2). By (1.18), there exists a > such that 

^^T Y-h(T )X+vo(\X\+\y\)] 

tela 



supE t [e am ] < E[e 7u ' 



Let R > and ir(x) G C£° (sppt($) n (-R,R)) such that < vr(x) < 1 and 
/ 7T(fi > 0. Now each F t has a subcomponent with density k x {t)n{x)(j){x) G 
Cq ((— R, R)). It is then seen that the conditions in Theorem 1.1 are satisfied. 

□ 

Proof of Lemma 4.2. By (4.2), h G C°°(I ) and E[e tY ~ h ^ x ] = 1, one 
can choose e G (0, and I = (t - e, r + e) such that (1) h(t) + e G T>° 

and |/i(i) — h(ro)\ < \ for every t G /; (2) sup tg/ p(t,a) < 1, Va G (0, e], where 
p(t,a) = £J[e* y -( fc W +e )- x ']; (3) inf te/ |/i (n) (*)l < oo, ra > 0. By Lemma 6.3, 
Vx > 0, M x (t) G C°°(I) and V0 < r) < 1, there exists If (r/) > such that 

(6.7) sup{e-^(|M^)| + \M' x (t)\ + |M£(f)|)} < tffa)^. 
tei 

We first show (4.7). From the definitions, for x > 0, 

(6.8) M x {t)=Pr{X>x}+ T g u (t)M x „ u (t)F(du), 

J — oo 

!B (<)=V'*(t)+ T k u {t)4> x - u {t)F(du) 



(6.9) 

= V*(*)+ / ^-nW^iW. 



-oo 

X 



DC 



From (6.7), sup x>0 tG/ {e ^^(i)} < oo, Ve <C 1. On the other hand, by 
the selection of Iq, fix < i n f/ h < mijh. Since i/j x (t) = e- h ^ x Pr{X>x}, 
there exists e > such that sup teI ip x (t) = o(e~ £X ). We now apply Lemma 
4.1 and Corollary 1.2 to (6.9). Then 



Et[X] 



oo r U / r\x\ 

Mt)dx- / / (j) u (t)du)F t (dx) 

J-oo\J0 
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uniformly exponentially fast for t £ I. The right-hand side is (f>(t), so (4.7) 
holds. 

It remains to show (4.6). Because A^) = - log M x (t) = - log (f> x (t) + h(t), 

x(p x (t) x4> x (ty 

Therefore, in order to obtain (4.6), it suffices to show that 

< oo, n = 1, 2. 



(6.10) limsupsup 

x— >oo tei 



To show (6.10) for <f> x {i), we first show that for x > and t G /, 
(6.11) 4L(t) = ifi(t)+ T (k u (t)^ x - u (t))'F(du), 



that is, | jl^kui^-ui^Fidu) = Jf oo (fc u (t)0 a: _ u (*))' 'F(du). It suffices to 
verify that for < £ < 1, /f^ sup| s „ i | <£ |(fe u (s)^> x _ u (s))"|F(dw) < oo. In- 
deed, as fc^t) = e- h W x £?[e tlr |X = x] and <f> x (t) = e~ h ^ x M x {t), by (6.7), 
it can be seen that for £<1, there exists C such that for n < 2, t G 7 
and x > 0, |A;i n) (£)| < Ce- fc W*^[e* y+6 l y l \X = x] and su P/ \<p ( x\t)\ < Ce £X . 
By (1.18), fix rj > and e E (0, §) such that Z := e^-M^+^l+m) G L 1 
and sup| s _ t | <£ |/i(s) — h(t)\ < |. It follows that supi s _ t i< £ |(fc u (s)^> x _ u (s))"| < 
4C 2 e ex [Z|X~= u] G L l (F) and hence (6.11) holds. 

Now let ^(t) = Jfoo k' u (t)<j) x - u (t)F (du) . By (6.11), #.(*) = ^(i) + 
/foo&-«(*)*W> where ^(t) = <(t) + w x (t). As k u (t)F(du) = 1, by 
an argument similar to that above, k' u {t)F{du) = 0. Then 

\k' u {t)Ux-u{t)-4>{t)\F{du) + cp{t) / |^(t)|F(dn). 

-oo J x 

From (4.7), sup tg/ \(j> x (t) — 4>{t) \ < Ce~ ax for < a <C 1. Combining the above 
results, we have 



,(i)|<C / X e- h{ - t)u - a{x - u) E[e tY+r i^\X = u)F{du) 

J — oo 

(■OO 

0(t) / e" /l W ,1+T '( x - u ) J E[e ty+, ' |y| |X = u]F( ( in) 

J a; 



+ < 

< Ce" (r?A£)x . 

On the other hand, because fix < inftg//i(i), (j>' x {t) = —xh'(t)e~ h ^ x x 
Pr{X>x} — > uniformly exponentially fast on /. Thus sup t£l \z x (t)\ — > 
exponentially fast and Corollary 1.2 can be applied to (6.11) to obtain 
supj- \4>' x (t) — 4>'(t)\ — > exponentially fast. It also implies that (f> G C 1 (cf. 
[20], Theorem 7.17). 
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The exponentially fast convergence sup tg/ \4>' x {t) — > <f>"(t)\ — ► can be proven 
likewise. To complete the proof, we must show that, by shrinking / if neces- 
sary, infig/ \4>(t)\ > 0. First, if X > 0, a.s., then this follows easily. Suppose 
that Pi{X > 0} < 1. Since 4> x (to) > 0, we have 4>(tq) = lim x 4> x (tq) > 0. If 
4>(tq) = 0, then 4> x (tq) — ► exponentially fast in x, that is, there exists a > 
such that M x (T )e~ h( - T0 ^ x = o(e~ ax ). This implies that limsup^ | log M x (t ) < 
h(ro). On the other hand, by condition (1.19) and Lemma 6.4, (1/x) logM x (ro) 
/i(ro). The contradiction implies that <P(tq) > 0. Since cj> is continuous around 
ro, we can shrink I to obtain mitei <p(t) > 0. This completes the proof of 
(6.10). □ 

Proof of Lemma 4.3. Without loss of generality, let d = 1 and Pr{Y > 
0} > 0. Clearly, W(x) C Z. By simple results from number theory, there exist 
yi, . . . ,y s G sppt(Y) such that for each large m G N, there exist c±, . . . , c s G N 
with J2 c iVi = m - Fi x Ti, i < s, such that Pr{X € Tj} > and Pr{Y = yi\X = 
x} > 0, Vx G Tj. Since the law of X has a subcomponent with a density 
and Pr{sup n ^r=i^« = °°} = 1? there exists to, such that the law of £0 : = 
J2i<t Xi has a subcomponent with a density in (0, 00). Then there exist ko 
and A C sppt(£ )° n (0, 00), with g(A) > and Pr{£i< to Y t = fc |£o = x}>0, 
Vx G A. By the property of measurable sets in R, {x + y : x, y G A} contains 
an interval (a, 6) 7^ 0. Let A; = 2&o, t = 2tQ. Then (a, 6) C sppt(^j<t Xi)° 
and Pr{X)i<t^ = &| J2i<t-^i = x} > 0, Vx G (a, 6). Finally, there exists / = 
[t,t+ 1] n sppt(X) with t > such that Pr{X G 1} > 0. Without loss of 
generality, assume that all Tj, (0,6) and / are in [—R,R] for some R > 0. 

Fix m, pi,. . . ,p s , gi,. . . ,q s G N such that Y.ViVi = m , Y.liVi = m + 1. 
Define p = J2pi, q = J2<li- We claim that for r>0, there exists n G N such 
that the events £"i and E2 defined as follows each has a positive probability. 
Ei is the joint event of (1) N(x) =nt + p, (2) X N r x \ + i G / and (3) {Zj := 
(Xi , Yi) , i < nt + p} can be partitioned into Bi , . . . , B s , Ci , . . . , C n such that 
\Bj \ = pj with Xi G Tj and Yi = yj for each Zj G Cj = {Zj^ , . . . , Z^.J, 
with X)/<t^"i ji ^ ( a )&) an( i SKt^iji = -^2 is defined likewise, with (/j re- 
placing of pj. Event £^1 implies that W(x) = nk + J2PiUi = nk + m, while E2 
implies that W(x) = nk + m + l. Therefore, nk + m,nk + m + l G sppt(W(x)) 
and W(x) has span 1. 

To verify the claim, let Tq = 1 + max{p, q}. For x ^> 0, there exists n G N 
such that ToR + na < x and —T$R+nb > x. This implies that for any zn, . . . , 
Zi Pi G Ti, i<s, and z € I, there exists a nonempty open interval J G (a, b) 
such that the inequalities 

n n 

^2 Zi i + - 2; ' ^Zij + ^2ui + z > x 

i,j i=l i,j i=l 

are satisfied by any u\, u n G J. Therefore, the probability that all 
of the following events on (X\, Yi), . . . , (X n t, Y n t) happen simultaneously 
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is positive: (1) T,i,j z ij + T,i X i < x > ( 2 ) T,i,j z ij + T,i X i + z > x and ( 3 ) 
V« < n, J2i<t x it+i e (a, 6) and Ej<t*it+Z = k- Let X nt+1 , . . . , X nt+P take 
values xu, . . . , z\ Pl , . . . , z s \, . . . , z sps , respectively, while let X nt +i = z, and 
Y nt+ i, . . .,Y nt+p take values yx,...,y s , respectively, such that Y nt+i = yj if 
J2{=iPh <j< E{=iPh- Then ^ i< n t+p Yi — nk + m. Rearrange (X\ , Y\), . . . , 
(X n t +p , l^ f+p ) so that those with negative values of Xi appear first. This 
results in N(x) = nt + p and W(x) = nk + m. Hence the claim holds for E\ . 
The case for E2 can be treated similarly. □ 

PROOF of Lemma 5.1. In order to show Lemma 4.2 with A x (t), 4> x (t) 
and 4>{t) being replaced by A x (t), (ft x (t) and 4>(x), note that 

Mt) = Mt) + r k u {t)4> x „ u {t)F(du) 

J — 00 

= Mt)+ f 4> x - u {t)F t {du), 

J — 00 

as opposed to (6.9). From the proof of Lemma 4.2, one can see that the 
lemma is implied by Lemma 4.1 and the fact that 

(6.12) sup|v4 n) (t)| =o( e - ax ), n = 0, 1, 2, for some a > 0. 

Indeed, (6.12) implies Lemmas 6.2-6.4, which are then combined with Lemma 
4.1, (6.12) and Corollary 1.2 to obtain (4.6) and (4.7). For the current proof, 
Lemma 4.1 still holds. Therefore, we only need to check (6.12) with ip x re- 
placed by tp x , as well as Lemmas 6.2-6.4. By Holder's inequality, 

1 POO I 

1^)1 = ^/ 9(t,u)F(du)<- m ,E[e^Pr{X>x}^, 

for all q > 1. Set q 3> so that (1 — -)Px < M r o) < 00 • By the assumption of 
Corollary 1.4, E[e qtY ] 1 ^ q < 00. Therefore, sup tg j |^ x (t)| = o(e~ ax ) for some 

a > 0. The exponential decay of sup te/ |^i n ^(t)| for n = 1,2 can be shown 
likewise. The proofs of Lemmas 6.2-6.4 for M x (t) closely follow those for 
M x {t). We omit the detail for brevity. 

From the proofs of (4.10) and (4.11), one can see that they are implied 
by conditions (1.17) and (1.18) as well as the fact that there exists a > 
such that sup t6/ x>0 \e 2ax ip x (t)\ < 00. Conditions (1.17) and (1.18) are still 
assumed here. It is not hard to show that there exists a > such that 
sup tgi - x>0 \e 2ax $ x (t)\ < 00. By now repeating the proofs, it is seen that (4.10) 
and (4.11) still hold when M n (t), A n (t) and U n replace M n (t), A n (t) and 
U n . □ 
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APPENDIX 

Proof of (3.2) and (3.3). Let P be the probability measure that has 
density p. As in [2], Vr G (0, 1), let q r be the density of X P *Yln=o rnpn * ■ Then 

Qr = XpJ2^=o rn P n = i^f)^ P ■ Since (1 — X P )N P is a probability measure, 

(1 - A p )|Ag < 1. By (3.7), $ p G L 1 . Therefore, x p = (l- \ P )$ P N p G L 1 . By 
|1 — rp| > 1 — r, q r £ L 1 . Given M > 0, by an inverse Fourier transform, 

qry ' 2W_oo l-rp(0) 27ri„ 00 V l-rp(e)J 

27r7_ii/ V l-rp(9)J 2n J\e\>M \ I - rp{9) ) 
s ' "> v ' 

h h 

Let e- ixe x P (9) = f{e)+ig{9),p{9) = u{9)+iv(9). Then 

For / 0, p{9) ± 1. Therefore, lim rT1 J x = f- + /(^^(^^j) d(9 (cf. [2], 
Lemma 10.11 or [24], page 330). By its definition, ty p has a finite mean, 
say a, and hence N p has finite first moment aJ2 n Kj- Consequently, Xp has 
a finite mean, yielding g(9) ~ p Xp 9 as # ^ 0. On the other hand, p(9) = 
1 + fj, p 9 + o{9). By dominated convergence for J2, as r f 1, 

Because p(0) — ► as # — ► 00, dominated convergence applies to /2- This 
then completes the proof of (3.2). To now obtain (3.3), first let x = 0. Because 
X P has a finite first moment and x p G L 1 , it is seen that /9 £ L 1 . For s > 

0, let = ^-Ho ia~ 0O sin(^) Xp (di))e" e2/2s2 ^- It is seen that g(s) con- 
verges to the left-hand side of (3.3) as s — > 00. On the other hand, by Fubini's 
theorem, g(s) = ± h(t, s) Xp (dt), where h(t, s) = JZo \ sm(t9) e - e ' 2 / 2 * 2 d9. 
Observe that dfh = 2irtp s (t), where ip s is the density of N(0, -). By h(0, s) = 
0, h(t,s) = 2vr(Pr{Z<st} - §), where Z ~ N(0,1). Therefore, g{s) = 
/^Pr{2 < st}xp{dt) — \. Let s — > 00 and apply dominated convergence 
to complete the proof. □ 
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